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PREFACE 



This paper presents a revised version of a report prepared for 
the Office of the Assistant Secretary for Program Evaluation, Depart- 
ment of Health, Education, and Welfare, during the summer of 1970. 

The impetus for the paper was generated by a seminar conducted by the 
author at The Rand Corporation in the spring of that year. 

The author wishes to thank four Rand colleagues who took time to 
read carefully, and to comment on, the manuscript: Harvey Averch, 

M. B. (Polly) Carpenter, John Pineus, and Marjorie Rapp. Thanks go 
also to Suzanne Mennine who rendered helpful editorial assistance. 
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SUMMARY 



Although the value of accurately estimated educational production 
functions would be considerable, such a feat is not possible in terms 
of currently available knowledge and data on the educational process, 
and probably not obtainable in the near future. It is therefore he- 
roic to use the production function ideal r.s a standard against which 
to judge current analytical contributions to the ••'ducat ional research 
field. Data limitations that make production function estimation the 
frustrating problem that it is today include the following inadequacies 

1. Too few technologies have been quantified; 

2„ Erroneous variables, or inadequate proxies, have been 
aval lab ie ; 

3. Non-longitudinal data have limited model specifications; 

4* Lack of Independent variance between variables has hampered 
results ; 

5. Inability to place schools on the efficiency f ntier has 

resulted from oui ignorance about the factor* .at constitute 
efficiency; 

< . Simultaneity, the existence of simultaneous relationships 
affecting learning, cannot be neglected; 

7. Aggregation of data causes problems because of the danger of 
lessening data variances. 

But it is the contention of this paper that multivariate analysis can 
yield important insights into the American educational process, that 
it can do so now, and that it can do so in the presence of all or r. ist 
of the difficulties outlined above. 

Although it may sacrifice some experimental precision in method- 
ology, the multivariate approach outlined here comes to grips with the 
problems of educational production function analysis by means of the 
following techniques! 

1. Using comparable measures of output across large experiments: 

2. Accounting systematically for differences in socioeconomic 
background; 

3. Treating the school as a complete syrrer.i in which different 
experiments can be related to each other. 
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These techniques, and especially the first two, differentiate the multi- 
variate work discussed here from other work. What kinds of results 
can we expect from this work? At least three can be listed. First, 
the findings provide a useful perspective for organizing educational 
research. Second, this approach has given us valuable information 
toward a meaningful description of American education. Third, the 
approach provides us with a convenient framework within which t j plan 
for future research. 

We can gain an accurate indication of interactions between such 
Variables as teacher experience, class size, and the like from experi- 
ments with linear and log-linear models. We can learn from the cogni- 
tive tests of basic skills what our society wishes children to learn. 
Knowing the types of inputs that seem to be associated with success 
within the present technology is important for suggesting direction. 

For example, analysis already conducted leads us to the tentative 
hypothesis that reliance cr teacher experience and formal education 
alone as a way of improving educational quality is inefficient; it 
would be better to' recruit intelligent teachers, and to engage in morn 
planning and on-the-job teacher training. The variables that we now 
have are of more value than has been suggested when examining broad 
educational policy questions. Although longitudinal data is vital for 
meaningful description of relationships in American education, much 
can be achieved for broad policy insights by cross-sectional data, 
when supplemented With other knowledge. 

Some fifteen studies employing multivaiiate techniques have al- 
ready been conducted. These contain useful inf< rmation that can be 
summarized under the following topics: 

1. The l.Ttportance of environment to educational success; 

2. The characteristics of the school, such as administration, 
funding integration, faci itles, and the teachers «s related 
to pupil performance; 

3. The implications of this information for future American 
education. 

Although American education has dealt adequately with the problems of 
the past twenty-five yearu, /t has faltered in flexibility, and that 
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has been expensive. Let us restate the arguments to support this view. 

The traditional technology has been too exclusively involved with 
the importance of the classroom teacher, who, utilizing group instruc- 
tion in the self-contained classroom, has been unable to cope well 
with the needs of atypical students. One possible solution to these 
difficulties, reducing class size, does not seem viable. Further, the 
incentive-reward structure for the teachers, the school system's only 
input, has been unsuccessful. Finally, since the number of college 
hours completed by teachers is seldom related to the performance of 
their pupil-s, something seems amiss in their training. 

This construct seems that which is most consistent with the find- 
ings in the multivariate studies reviewed in this paper. Some obvious 
directions for public educational policy are suggested. We need to 
look at new organizational design, teamwork, and studies to determine 
what it is about teacher and manager sVills that relates to pupil per- 
formance. We need to develop objective measures of performance other 
than cognitive test scores if we are to come to grips with measuring 
the results that our schorls and communities wi*>h to accomplish. We 
need to think about the levels upon which to conduct educational re- 
search and development. In the past, what direction there has been 
came from the universities. But work there has not focused directly 
or questions of interest to the policymaker . It is the place of the. 
Federal government to provide central direction, performing this role 
thrrugh a National Institute of Education, maintaining liaison '"Tth, 
but not a part of, the research activities of the Office of Education. 
Through this means, research could be carried out that might, in time, 
allow us to come close to definition of educational production functions. 
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I . TKh PRODUCTION FUNCTION AS AN ANALYTICAL TECHNIQUE 



In recent years there has been considerable interest among edu- 
cational researchers in an analytical technique for relating school 
inputs to objective performance measures which has come to be known 
as "production function" analysis. After some early optimism con- 
cerning the potential of the approach, researchers began to see more 
clearly the limitations imposed by the data available to them. The 
pessimism which resulted is probably well grounded from the standpoint 
of "solving" educational technology, but there is less justification 
for a concomitant tendency on the part of researchers to overlook some 
important inferences which can be obtained using such models and data 
as are aval lab le . 

In this paper I hope to show that social scientists have been 
overambit ious even to discuss their research in terms of educational 
production functions. At the same time, my purpose is to demonstrate 
that considerable insight into the workings of the American education- 
al structure can be obtained with less ambitious multivariate models 
which take pupil socioeconomic background and educational policy vari- 
ables into account. The paper includes a discussion of the direction 
I think educational research should take in the future, and the role 
of the Federal government in those efforts. 

THE CONCEPT OF A PRODUCTION FUNC TION 

The production function is one of the more important concepts 
available tc the economist in his study of the firm. Simply stated, 
a production function is a statement of all combina t ions of inputs, 
physical and human, meaningfully classified, which, when used as ef- 
ficiently as possible, will produce a given level of output, A ton 
of steel, for example, can be produced by many workers using small 
open hearths, or by few workers and large open hearth furnaces, or oxy 
gen furnaces or a Bessemer process. This production function concept 
is useful both as an economic and an engineering tool. By considering 
input prices the economist finds it a simple matter to choose between 
efficient processes to find the most economical one; meanwhile the 
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engineer is busy working with each process to wake it more efficient, 
that is, to make technological progress. It is the task of the firm's 
managers, finally, to see to it that the firm has chosen the proper 
process from an economic point of view, and is using that process as 
efficiently as possible from an engineering point of view. 

Since schools can be easily characterized as firms, the production- 
function concept should be helpful in the analysis of their efficiency. 
The most immediate problem is obtaining a viable product measure, since 
the educational process is obviously concerned v.’ith a much more compli- 
cated product than the steel-making process. But assuming that some 
reasonable starting point is available for a product measure, the ap- 
proach would seem to be valuable for examining educational organizations 
as systems. 

It would be of potential value to obtain accurately estimated edu- 
cational production functions. It would then be possible to obtain a 
maximunt-ef f iciency solution for the marginal product per doller of each 
educational input, and since solution values must be equal for each in- 
put when the firm is operating on the efficiency frontier, the estimated 
function could readily be compared to actual school practices From the 
magnitudes of the coefficients (multiplied by the proper dollar costs 

of their factors) one could infer which input ought to be increased 

•k 

relative to the others. 

But such estimated production functions will not be obtainable in 
the near future, if ever, and it is therefore heroic to use such attain- 
ment as the ideal against which to judge current work. Inasmuch as 
this ideal has tended to divert the attention of researchers from notic- 
ing potential policy insights which could be obtained with less so- 

kk. 

phlsticated analysis, such idealism, in itself, may have been harmful. 



*Farrell [1]. 

Thus, Brandi [2] in commenting upon Bowles' [3] early discussion 
of the educational production function, concludes that the paper "leaves 
little room for hope that estimations of educational production functions 
from survey data can be very useful for policy purposes in the forseeable 
future 11 (p. 1). Brandi’s pessimism Is based almost entirely upon the 
failure of such analysis to achieve the marginal product ratios discussed 
above, apparently forgetting that such analysis may have other important, 
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